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MULTILAYER CONTROL OF GOBO SHAPE 



This application claims the benefit of U.S. 
Provisional Application No . 60/155, 513, filed on September 
5 22, 1999. 

Field 

The present invention relates to a system of 
controlling light beam pattern Cgobo 11 ) shape in a 
10 pixilated gobo control system using a multilayer control. 



system which operates based on computer-provided commands to 
15 form special effects. One of those effects is control of 

the shape of a light pattern that is transmitted by the 

device. This control is carried out on a pixel -by-pixel 

basis, hence referred to in this specification as pixilated. 

Control is also carried out using an x-y controllable 
20 device. The embodiment describes using a digital mirror 

device, but other x-y controllable devices such as a grating 

light valve, are also contemplated. 

The computer controlled system includes a digital 

signal processor which is used to create an image command. 
25 * That image command controls the pixels of the x-y 



Background 



US patent number 



describes a stage lighting 
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controllable device to shape the light that it is output 
from the device. 

The system described in the above-referenced 
application allows unparalleled flexibility in selection of 
5 gobo shapes and movement; This opens an entirely new 
science of controlling gobos . 



10 y controllable device to form special electronic light 

pattern shapes. More specifically, the present application 
describes different aspects of communication with an 
electronic gobo. These aspects include improved processing 
or improved controls for the gobo and various ways of 

15 forming the user interface for such a device. 

The present specification discloses controlling gobos 
based on layers. A complex light passing outline is defined 
by a number of different layers, each of which includes some 
number of items for the gobo. 



Brief Description of the Drawings 
These and other aspects of the invention will now be 
described with reference to the attached drawings, in which: 



Summary 



The present disclosure defines communicating with an x- 



20 



FIG. 1 shows a block diagram of the basic system 



25 operating the embodiment; 



FIG. 2 shows a basic flowchart of operation; 
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FIG. 3 shows a flowchart of forming a replicating 
circles type gobo; 

FIGS. 4A through 4G show respective interim results of 
carrying out the replicating circles operation; 
5 FIG. 5 shows the result of two overlapping gobos 

rotating in opposite directions; and 

FIGS. 6(1) through 6(8) show a z-axis flipping gobo. 
FIGS. 7A - 7C show overlapping square gobos. 
FIG. 8 shows the DSP for this operation. 
10 FIG. 9 shows a y/c conversion. 

M FIG. 10 shows a framing shutter. 

^ FIG. 11 shows a transfer controller. 

FIG 12 shows a layout of the layered system. 
FIG. 13 shows a gobo selection tree. 

15 

Description of the Preferred Embodiment 
FIG. 1 shows a block diagram of the hardware used 
according to the preferred embodiment. As described above, 
this system uses a digital mirror device 100, which has also 
20 been called a digital mirror device P"DMD M ) and a digital 
light processor device (""DLP M ). More generally, any 
system which allows controlling shape of, light on a pixel 
basis, including a grating light valve, could be used as the 
light shaper. This light shaper forms the shape of light 
25 which is transmitted. FIG. 1 shows the light being 

transmitted as 102, and shows the transmitted light. The 
information for the digital mirror 100 is calculated by a 
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digital signal processor 106. Information is calculated 
based on local information stored in the lamp, e.g., in ROM 
109, and also in information which is received from the 
console 104 over the communication link. 
5 The operation is commanded according to a format. 

The preferred data format provides 4 bytes for each of 
color and gobo control information. 

The most significant byte of gobo control data, 
(""dfGobo'*) indicates the gobo type. Many different gobo 

10 types are possible. Once a type is defined, the gobo formed 
from that type is represented by a number. That type can be 
edited using a special gobo editor described herein. The 
gobo editor allows the information to be modified in new 
ways, and forms new kinds of images and effects. 

15 The images which are used to form the gobos may have 

variable and/or moving parts. The operator can control 
certain aspects of these parts from the console via the gobo 
control information. The type of gobo controls the gobo 
editor to allow certain parameters to be edited. 

2 0 The examples given below are only exemplary of the 

types of gobo shapes that can be controlled, and the 
controls that are possible when using those gobo shapes.- Of 
course, other controls of other shapes are possible and 
predictable based on this disclosure. 

25 

First Embodiment 
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A first embodiment is the control of an annulus, or 
"ring" gobo. The DMD 100 in Figure 1 is shown "with the ring 
gobo being formed on the DMD. The ring gobo is type 00 OA. 
When the gobo type OA is enabled, the gobo editor 110 on the 
5 console 104 is enabled and the existing gobo encoders 120, 
122, 124, and 126 are used. The gobo editor 110 provides 
the operator with specialized control over the internal and 
the external diameters of the annulus, using separate 
controls in the gobo editor. 

10 The gobo editor and control system also provides other 

capabilities, including the capability of timed moves 
between different edited parameters. For example, the ring 
forming the gobo could be controlled to be thicker. The 
operation could then effect a timed move between these 

15 "preset" ring thicknesses. Control like this cannot even be 
attempted with conventional fixtures. 

Another embodiment is a composite gobo with moving 
parts. These parts can move though any path that are 
programmed in the gobo data itself. This is done in 

20 response to the variant fields in the gobo control record, 
again with timing. Multiple parts can be linked to a single 
control allowing almost unlimited effects. 

Another embodiment of this system adapts the effect for 
an "eye" gobo, where the pupil of the eye changes its 

25 position (look left, look right) in response to the control. 

Yet another example is a Polygon record which can be 
used for forming a triangle or some other polygonal shape . 
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The control can be likened to the slider control under 
a QuickTime movie window, which allows you to manually move 
to any point in the movie. However, our controls need not be 
restricted to timelines. 
5 Even though such moving parts are used, scaling and 

rotation on the gobo is also possible. 

The following type assignments are contemplated: 



00 


OF 


= FixedGobo 


(with no 


"moving 


parts") 


10 


IF 


= SingleCntrl 


(with 1 


"moving 


part" ) 


20 


2F 


= DoubleCntrl 


(with 2 


"moving 


parts" ) 


30 


_ FF 


= undefined, 


reserved . 







The remaining control record bytes for- each type are 
defined as follows: 

15 Byte: dfGobo2 dfGobo3 dfGobo4 #gobos./type , total 

memory 




FixedGobo: ID[23:16] ID[15:8] ID[7:0] 16M/type 

256M SingleCntrl : ID [15: 8] ID [7:0] control#l 64k/type 

20 1M DoubleCntrl: ID [7:0] control#2 control#l 256/type 
4k 



As can be seen from this example, this use of the 
control record to carry control values does restrict the 
25 number of gobos which can be defined of that type, 
especially for the 2 -control type. 
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Console support : 

The use of variant part gobos requires no modifications 
to existing console software for the ICON (7M) console. The 
Gobo editor in current ICON software already provides 4 
separate encoders for each gobo. These translate directly 
to the values of the 4 bytes sent in the communications data 
packet as follows: 



10 Byte: 



15 



20 



25 



Enc : 

FixedGobo : 
SingleCntrl : 
DoubleCntrl : 



dfGobo dfGobo2 df Gobo3df Gobo4 

TopRight MidRight BotRightBotLef t 

ID [23 : 16] ID [15 : 8] ID [7 : 0] 

ID [15: 8] ID [7 0] control#l 

ID [7:0] control#2 control#l 



These values would be part of a preset gobo, which 
could be copied as the starting point. 

Once these values are set, the third and fourth 
channels automatically become the inner/outer radius 
controls. Using two radii allows the annulus to be turned 
"inside out" . 

Each control channel's data always has the same meaning 
within the console. The console treats these values as 
simply numbers that are passed on. The meanings of those 
numbers, as interpreted by the lamps change according to the 
value in dfGobo. 
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The lamp will always receives all 4 bytes of the gobo 
data in the same packet. Therefore, a "DoubleCntrl " gobo 
will always have the correct control values packed along 
with it. 

Hence, the console needs no real modification. If a 
"soft 11 console is used, then name reassignments and/or key 
reassignments may be desirable. 



Timing : 

10 For each data packet, there is an associated "Time" for 

gobo response. This is conventionally taken as the time 
allotted to place the new gobo in the light gate. This 
delay has been caused by motor timing. In this system, 
variant gobo, the control is more dynamically used. If the 

15 non-variant parts of the gobo remain the same, then it is 

still the same gobo, only with control changes. Then, the 
time value is interpreted as the time allowed for the 
control change. 

Since different gobo presets (in the console) can 

20 reference the same gobo, but with different control 

settings, this allows easily programmed timed moves between 
different annuli, etc. 



Internal Workings : 

25 When the gobo command data is extracted from the packet 

at the lamp, the dfGobo byte is inspected first, to see if 
either dfGobo3 or dfGobo4 are significant in selecting the 
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image. In the case of the "Cntrl" variants, one or both of 
these bytes is masked out, and the resulting 32 -bit number 
is used to search for a matching gobo image (by Gobo _1D) in 
the library stored in the lamp's ROM 109. 
5 If a matching image is found, and the image is not 

already in use, then the following steps are taken: 

1) The image data is copied into RAM, so that its 
fields may be modified by the control values. This step 
will be skipped if the image is currently active. 

10 2) The initial control values are then recovered from 

the data packet, and used to modify certain fields of the 
image data, according to the control records. 

3) The image is drawn on the display device, using the 
newly-modified fields in the image data. 

15 If the image is already in use, then the RAM copy is 

not altered. Instead, a time-sliced task is set up to slew 
from the existing control values to those in the new data 
packet, in a time determined by the new data packet. 

At each vertical retrace of the display, new control 

20 values are computed, and steps 2 (using the new control 

values) and 3 above are repeated, so that the image appears 
modified with time. 

The image data records : 

25 All images stored in the lamp are in a variant record 
format : 
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Header : 

Length 32 bits, offset to next gobo in list. 
Gobo _1D 32 bits, serial number of gobo. 

5 Gobo records : 

Length 32 bits, offset to next record. 
Opcode 16 bits, type of object to be drawn. 
Data Variant part - data describing object. 
_Length 32 bits, offset to next record. 
10 Opcode 16 bits, type of object to be drawn. 

Data Variant part - data describing object. 

_ EndMarker 64 bits, all zeroes - indicates end of gobo 

data . 

+ Next gobo, or End Marker, indicating end of gobo list. 

15 

Gobos with controls are exactly the same,, except that 
they contain control records, which describe how the control 
values are to affect the gobo data. Each control record 
contains the usual length and Opcode fields, and a field 

20 containing the control number (1 or 2) . 

These are followed by a list of "field modification" 
records. Each record contains information about the offset 
(from the start of the gobo data) of the field, the size (8, 
16 or 32 bits) of the field, and how its value depends on 

25 the control value. 



Length 32 bits, offset to next record 



10 



10 



15 



Opcode 
CntrlNum 

Address 

Flags 

etc) 

Scale 

use 

zPoint 

Address 

field. 

Flags 

etc) 

Scale 

use 

zPoint 
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16 bits = control_record (constant) 
16 bits = 1 or 2 (control number) 
/* field modification record #1 */ 

16 bits, offset from start of gobo to affected field. 
16 bits, information about field (size, signed, 

16 bits, scale factor applied to control before 

16 bits, added to control value after scaling. 

/* field modification record #2 */ 

16 bits, offset from start of gobo to affected 

16 bits, information about field (size, signed, 

16 bits, scale factor applied to control before 

16 bits, added to control value after scaling. 



As can be seen, a single control can have almost 
20 unlimited effects on the gobo, since ANY values in the data 
can be modified in any way, and the number of field 
modification records is almost unlimited. 

Note that since the control records are part of the 
gobo data itself, they can have intimate knowledge of the 
25 gobo structure. This makes the hard-coding of field offsets 
acceptable. 
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In cases where the power offered by this simple 
structure is not sufficient, a control record could be 
defined which contains code to be executed by the processor. 
This code would be passed parameters, such as the address of 
5 the gobp data, and the value of the control being adjusted. 

Example records • 

The Annulus record has the following format: 
Length 32 bits 

10 Opcode 16 bits, = type_annulus 

l«j Pad 16 bits, unused 

,S Centre_x 16 bits, x coordinate of centre 

^ Centre_y 16 bits, y coordinate of centre 

JrJ OuterRad 16 bits, outside radius (the radii get swapped 

.+= 15 when drawn if their values are in the wrong order) 

O InnerRad 16 bits, inside radius 



HI 



It can be seen from this that it is easy to "target" 
one of the radius parameters from a control record. Use of 
20 two control records, each with one of the radii as a target, 
would provide full control aver the annulus shape. 

Note that if the center point coordinates are modified, 
the annulus will move around the display area, independent 
of any other drawing elements in the same gobo's data. 



25 



The Polygon record for a triangle has this format: 
Length 32 bits 
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Opcode 




16 


bits, 




type_polygon 




Pad 




16 


bits , 


vertex count 


= 3 




Centre_ 


X 


16 


bits, 


X 


coordinate 


of 


vertex 


Centre_ 


_y 


16 


bits, 


y 


coordinate 


of 


vertex 


Centre_ 


X 


16 


bits, 


X 


coordinate 


of 


vertex 


Centre_ 


_y 


16 


bits, 


y 


coordinate 


of 


vertex 


Centre_ 


X 


16 


bits, 


X 


coordinate 


of 


vertex 


Centre 


_y 


16 


bits , 


y 


coordinate 


of 


vertex 



ST* 



10 It is easy to modify any of the vertex coordinates, 

producing distortion of the triangle. 

The gobo data can contain commands to modify the 
drawing environment, by rotation, scaling, offset, and color 
control, the power of the control records is limitless. 



£ 15 



Second Embodiment 
This second embodiment provides further detail about 
implementation once the gobo information is received. 

Gobo information is, at times, being continuously 
20 calculated by DSP 106. The flowchart of FIG. 2 shows the 
handling operation that is carried out when new gobo 
information is received. 

At step 200, the system receives new gobo information. 
In the preferred embodiment, this is done by using a 
25 communications device 111 in the lamp 99. The 

communications device is a mailbox which indicates when new 
mail is received. Hence, the new gobo information is 
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received at step 200 by determining that new mail has been 
received . 

At step 202, the system copies the old gobo and 
switches pointers. The operation continues using the old 
5 gobo until the draw routine is called later on. 

At step 204, the new information is used to form a new 
gobo. The system uses a defined gobo ("dfGobo'') as 
discussed previously which has a defined matrix. The type 
dfGobo is used to read the contents from the memory 109 and 
10 thereby form a default image. That default image is formed 
in a matrix. For example, in the case of an annulus, a 
default size annulus can be formed at position 0,0 in the 
matrix. An example of forming filled balls is provided 
herein. 

g 15 Step 206 represents calls to subroutines. The default 

gobo is in the matrix,, but the power of this system is its 
ability to very easily change the characteristics of that 
default gobo. In this embodiment, the characteristics are 
changed by changing the characteristics of the matrix and 
2 0 hence, shifting that default gobo in different ways. The 
matrix operations, which are described in further detail 
herein, include scaling the gobo, rotation, iris, edge, 
strobe, and dimmer. Other matrix operations are possible. 
Each of these matrix operations takes the default gobo, and 
25 does something to it. 

For example, scale changes the size of the default 
gobo.** Rotation rotates the default gobo by a certain 



§ y 
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amount. Iris simulates an iris operation by choosing an 

area of interest, typically circular, and erasing everything 
outside that area of interest. This is very easily done in 
the matrix, since it simply defines a portion in the matrix 
where all black is written. 

Edge effects carry out certain effects on the edge such 
as softening the edge. This determines a predetermined 
thickness, which is translated to a predetermined number of 
pixels, and carries out a predetermined operation on the 
number of pixels. For example, for a 50% edge softening, 
every other pixel can be turned off. The strobe is in 
effect that allows all pixels to be turned on and off at a 
predetermined frequency, i.e., 3 to 10 times a second. The 
dimmer allows the image to be made dimmer by turning off 
some of the pixels at predetermined times. 

The replicate command forms another default gobo, to 
allow two different gobos to be handled by the same record. 
This will be shown with reference to the exemplary third 
embodiment showing . balls . Each of those gobos are then 
handled as the same unit and the entirety of the gobos can 
be, for example, rotated. The result of step 206 and all of 
these subroutines that are called is that the matrix 
includes information about the bits to be mapped to the 
digital mirror 100. 

At step 208, the system then obtains the color of the 
gobos from the control record discussed previously. This 
gobo color is used to set the appropriate color changing 
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circuitry 113 ayid 115 in the lamp 99. Note that the color 
changing circuitry is shown both before and after the 
digital mirror 100. It should be understood that either of 
those color changing circuits could be used by itself. 
5 At step 210, the system calls the draw routine in which 

the matrix is mapped to the digital mirror. This is done in 
different ways depending on the number of images being used. 
Step 212 shows the draw routine for a single image being 
used as the gobo. In that case, the old gobo, now copied as 

10 shown in step 202, is faded out while the new gobo newly 

calculated is faded in. Pointers are again changed so that 
the system points to the new gobo. Hence, this has the 
effect of automatically fading out the old gobo and fading 
in the new gobo . 

15 Step 214 schematically shows the draw routine for a 

system with multiple images for an iris. In that system, 
one of the gobos is given priority over the other. If one 
is brighter than the other, then that one is automatically 
given priority. The one with priority 2, the lower priority 

20 1, is written first. Then the higher priority gobo is 

written. Finally, the iris is written which is essentially 
drawing black around the edges of the screen defined by the 
iris. Note that unlike a conventional iris, this iris can 
take on many different shapes. The iris can take on not 

25 just a circular shape, but also an elliptical shape, a 

rectangular shape, or a polygonal shape. In addition, the 
iris can rotate when it is non-circular so that for the 
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example of a square iris, the edges of the square can 
actually rotate. 

Returning to step 206, in the case of a replicate, 
there are multiple gobos in the matrix. This allows the 
5 option of spinning the entire matrix, shown as thin matrix. 

An example will now be described with reference to the 
case of repeating circles. At step 200, the new gobo 
information is received indicating a circle. This is 
followed by the other steps of 202 where the old gobo is 
10 copied, and 204 where the new gobo is formed. The specific 
_ operation forms a new gobo at step 300 by creating a circle 

of size diameter equals 1000 pixels at origin 00. This 

ill 

ffl default circle is automatically created. FIG. 4A shows the 

in 

m default gobo which is created, a default size circle at 00. 

n i 

jr 15 It is assumed for purposes of this operation that all of the 
H circles will be the same size. 

«j At step 302, the circle is scaled by multiplying the 

!if entire circle by an appropriate scaling factor.- Here, for 

w simplicity, we are assuming a scaling factor of 50% to 

20 create a smaller circle. The result is shown in FIG. 4B. A 
gobo half the size of the gobo of FIG. 4A is still at the 
origin. This is actually the scale of the subroutine as 
shown in the right portion of step 302. Next, since there 
will be four repeated gobos in this example, a four- loop is 
25 formed to form each of the gobos at step 3 04. Each of the 
gobos is shifted in position by calling the matrix operator 
shift. In this example, the gobo is shifted to a quadrant 
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to the upper right of the origin. This position is referred 
to as n over 4 in the FIG. 3 flowchart and results in the 
gobo being shifted to the center portion of the top right 
quadrant as shown in FIG. 4C. This is again easily 
5 accomplished within the matrix by moving the appropriate 
values. At step 308, the matrix is spun by 90 degrees in 
order to put the gobo in the next quadrant as shown in FIG. 
4D in preparation for the new gobo being formed into the 
same quadrant. Now the system is ready for the next gobo, 

10 thereby calling the replicate command which quite easily 
creates another default gobo circle and scales it. The 
four-loop is then continued at step 312. 

The replicate process is shown in FIG. 4E where a new 
gobo 402 is formed in addition to the existing gobo 400. 

15 The system then passes again through the four-loop, with the 
results being shown in the following figures. In FIG. 4F, 
the new gobo 402 is again moved to the upper right quadrant 
(step 306) . In FIG. 4G, the matrix is again rotated to 
leave room for a new gobo in the upper right quadrant. This 

2 0 continues until the end of the four- loop. Hence, this 
allows each of the gobos to be formed. 

Since all of this is done in matrix operation, it is 
easily programmable into the digital signal processor. 
While the above has given the example of a circle, it should 

25 be understood that this scaling and moving operation can be 
carried out for anything. The polygons, circles, annulus, 
and any other shape is easily scaled. 
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The same operation can be carried out with the multiple 
parameter gobos . For example, for the case of a ring, . the 
variable takes the form annulus (inner R, outer R, x and y) . 
This defines the annulus and turns of the inner radius, the 
5 outer radius, and x and y offsets from the origin. Again, 
as shown in step 3, the annulus is first written into the 
matrix as a default size, and then appropriately scaled and 
shifted. In terms of the previously described control, the 
ring gobo has two controls: control 1 and control 2 defined 

10 the inner and outer radius. 

Each of these operations is also automatically carried 
out by the command repeat count which allows easily forming 
the multiple position gobo of FIGS. 4A-4G. The variable 
auto spin defines a continuous spin operation. The spin 

15 operation commands the digital signal processor to 

continuously spin the entire matrix by a certain amount each 
time . 

One particularly interesting feature available from the 
digital mirror device is the ability to use multiple gobos 

2 0 which can operate totally separately from one another raises 
the ability to have different gobos spinning in different 
directions. When the gobos overlap, the processor can also 
calculate relative brightness of the two gobos. ' In 
addition, one gobo can be brighter than the other. This 

25 raises the possibility of a system such as shown in FIG. 5. 
Two gobos are shown spinning in opposite directions: the 
circle gobo 500 is spinning the counterclockwise direction, 
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while the half moon gobo 502 is spinning in the clockwise 
direction. At the overlap, the half moon gobo which is 
brighter than the circle gobo, is visible over the circle 
gobo. Such effects were simply not possible with previous 
5 systems. Any matrix operation is possible, and only a few 
of those matrix operations have been described herein. 

A final matrix operation to be described is the 
perspective transformation. This defines rotation of the 
gobo in the Z axis and hence allows adding depth and 
10 perspective to the gobo. For each gobo for which rotation 
is desired, a calculation is preferably made in advance as 
to what the gobo will look like during the Z axis 
transformation. For example, when the gobo is flipping in 
the Z axis, the top goes back and looks smaller while the 
4= 15 front comes forward and looks larger. FIGS. 5A-5C show the 
q varying stages of the gobo flipping. In FIG. 5D, the gobo 

|Tj has its edge toward the user. This is shown in FIG. 5D as a 

j». very thin line, e.g., three pixels wide, although the gobo 

could be zero thickness at this point. Automatic algorithms 
20 are available for such Z axis transformation, or 

alternatively a specific Z axis transformation can be drawn 
and digitized automatically to enable a custom look. 

Third Embodiment 
25 The gobo record format described above can have two 

gobos therein. These two gobos can be gobo planes, which 
can be used to project one image superimposed over another 
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image in a predefined way. For example, a first image can 
be a pattern that emits light, e.g., a standard gobo. The 
second image can be totally transparent, or can have holes 
through which the first image can be seen. 

Analog gobos often project light through two gobos . 
The light is then projected through the intersection between 
the two gobos. Effectively, this takes an AND function 
between the gobos. Light will only be passed in places 
where both gobos are open. 

In the present system, any function between two images 
can be projected as an overall gobo shape. The system can, 
e.g., project the "or" between the two images. Moreover, 
the two images can be projected in separate colors. 
Therefore, for example, the system used in FIGS. 7A-7B could 
be carried out in software. 

A first gobo shown in FIG. 7A is a square gobo. For 
purposes of this example, the square gobo is projected in 
red, forming a first lighted portion. The exterior non- 
projected portion 702 is black. FIG. 7B shows the second 
gobo to be added to the first gobo. The second gobo is an 
off-center circle 704 to be projected in blue. The AND 
between these two gobos would transmit only the intersection 
between the two gobos, shown by the hatched portion 706. 
Moreover, this portion could only be transmitted in the 
additive or subtractive combination between the two colors, 
red and blue. 
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The present system defines the two images as separate 
planes. This enables transmitting the "or" between the two 
images. Therefore, both the first image 700 and the second 
image 704 are transmitted. Moreover, the intersection 
5 portion of the image 706 can be made in any desired color, 
either the color of either, the color of the subtractive 
combination, or a totally different color while this system 
describes an ""or' 1 operation, it also encompasses any 
combination between the gobos : e.g., X or, Schmitt-triggered 
10 (hysteresis-induced) and/or, others. 
^ The gobo operation is simplified and made more 

;j=j efficient by using a transfer controller as described 

Us herein. 

IB FIG. 8 shows the basic block diagram of this 

J= 15 embodiment. The Digital Signal Processor (DSP) 800 
q effectively functions as the central processing unit. The 

m preferred DSP for this embodiment is the TI TMS 320C80. 

j» This includes a 64-bit bus 802. Memory 804 is attached to 

the bus 802. The memory 804 effectively forms a working 
20 portion. A transfer controller 810 is provided and allows 
increased speed. The transfer controller can take control 
of the bus and can carry out certain functions. One such 
function is a direct memory access. This allows moving 
information from the program memory 8 04 to a desired 
25 location. The transfer controller receives information 

about the data to be moved, including the start location of 
the data, the number of bytes of the date, and the end 
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location of the data. The destination and operation is also 
specified by the data 809. The transfer controller 810 then 
takes the data directly from the memory 804, processes it, 
and returns it to the memory or to the DMP without DSP 
5 intervention. The CPU can then therefore tell the transfer 
controller to take some action and then can itself do 
something else. 

Also on the bus 802 is a hardware block 820 which is , 
preferably formed from a Field Programmable Gate 
10 Array (FPGA) . The FPGA can be configured into logical 
blocks as shown. The DSP also sends commands that 8 07 
reconfigure the FPGA as needed. The FPGA can be 
reconfigured to form fast Synchronous Dynamic Random Access 
Memory (SDRAM) shown as 822. 
g 15 The preferred DSP 800 is a TI TMS 320C80. This device 

=3 includes an associated transfer controller which is a 

7; combined memory controller and DMA (direct memory access) 

is? 

jf machine. It handles the movement of data and instructions 

^ within the system as required by the master processor, 

20 parallel processors, video controller, and external devices. 

The transfer controller performs the following data- 
movement and memory-control functions: 

MP and ADSP instruction-cache fills 
MP data-cache fills and dirty-block write-back 
25 MP and ADSP packet transfers (PTs) 

Externally initiated packet transfers (XPTs) 
VC packet transfers (VCPTs) 



iV4 
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MP and ADSP direct external accesses (DEAs) 
VC shift-register-transfer (SRTs) 
DRAM refresh 
sExternal bus requests 
5 Operations are performed on the cache sub-block as requested 
by the processors' internal cache controllers. DEA 
operations transfer off-chip data directly to or from 
processor registers. Packet transfers are the main data 
transfer operations and provide an extremely flexible method 
10 for moving multidimensional blocks of data (packets) between 
>& on-chip and/or off-chip memory. 

*B Key features of the this specific transfer controller 

111 include: 

IB 

ffl Crossbar interface 

15 64-bit data path 

Single -cycle access 
External memory interface 

4G-byte address range dynamically configurable memory cycles 
Bus size of 8, 16, 32, or 64 bits 
20 Selectable memory page size 

Selectable row/column address multiplexing 
Selectable cycle timing 

Big or little indian operation Cache, VRAM, and refresh 
controller 
25 Programmable refresh rate 
VRAM block-write support 

Independent source and destination addressing 
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Autonomous address generation based on packet transfer 
parameters 

Data can be read and written at different rates 
Numerous data merging and spreading functions can be 
5 performed during transfers 

Intelligent request prioritization 

Hence, the transfer controller allows definition of the 
limits of the message/data, and then the information can be 
automatically handled. The transfer controller also can 

10 generate a table of end points, carry out direct -memory 

access, and manipulate the data while transferring the data. 

The SDRAM 822 can be used as fast -image memory, and can 
be connected, for example, to an image storage memory 830. 
The FPGA can also be configured to include serial 

15 interfaces 824, 826 with their associated RAM 828, 829 
respectively. Other hardware components can also be 
configured by the FPGA. 

Since the FPGA can be reconfigured under control of the 
processor 800, the FPGA can be reconfigured dynamically to 

20 set an appropriate amount of SDRAM 822. For example, if a 

larger image or image processing area is necessary, the FPGA 
can be reconfigured to make more of it into image memory. 
If a smaller image is desired, less of the FPGA can be made 
into SDRAM, allowing more of the FGPA for other hardware 

25 functions. Moreover, the interfaces 832, 834 can be 

dynamically reconfigured. For example, the baud rate can be 
changed, bus width can be reconfigured, and the like. 
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The serial receiver 824 receives the ICON data from the 
controller, as described in our copending application, 
7319/63. The serial driver 826 produces a serial output 
that can drive, for example, an RS422 bus that runs the 
5 motors. 

The C80 DSP includes the transfer controller as a part 
thereof. An alternative embodiment uses a different DSP. 
The functions of the transfer controller are then replicated 
in the FPGA, as desired. For example, an alternative 
10 possible DSP is the C6201 which uses the Very Large 
^ Instruction Word "VLIW" architecture. This system can use, 

*5 for example, 128 -bit instructions. However, since this is 

m 

ffl connected to the 32 -bit data bus, a transfer controller 

IB could be highly advantageous. This would enable the 

111 

15 equivalent of direct memory access from the memory. FIG. 11 
P shows the gate array schematic of this alternate embodiment 

in which the transfer controller is part of the FPGA. 

S3 s 

— A second embodiment of the gate array logic, as 

^ preferably used according to the present system, is shown in 

20 FIG. 11. This gate array logic is formed in the field- 
programmable gate array and carries out many of the 
functions described herein. Block 1100 corresponds to a 
transparency device which calculates values associated with 
transparency. Block 1102 is a dual -port RAM which receives 

25 the VLIW at one port thereof, and outputs that value to a 
multiplexer 1104, which converts it to the 32 bits used by 
the CPU/DSP. The write poster 1104. Transfer 
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controller 1106 has the functionality discussed above, and 
is controlled directly by the CPU data received on 
line 1105. The transfer controller can have two lists of 
parameters, each 64 bits in width. These values are 
5 received on the list receivers 1110, 1112. 

Another issue noted by the current inventors is the 
size of images. If possible, it is desirable to avoid using 
uncompressed images. For example, one easy form image to 
manipulate is a bitmap, also known as a " .bmp" type image. 
10 The bitmap represents each pixel of the image by a number of 
_ bits, e.g., for an 8 -bit 3 -primary color image, each. pixel 

*S would require 24 bits. This can, unfortunately, use 

III 

III incredible amounts of storage. However, since the bit map 

CO 

fr) has a 1-to-l correspondence with the image, it can be 

I y 

s p 15 relatively easy to manipulate the bit map. For example, a 
q matrix representing the bitmap can be easily manipulated, 

^ e.g., rotated. The image form can be compressed, e.g., to a 

i y 

GIF or JPEG image. This image, however, loses the one -to- 
s one correspondence and hence cannot be directly processed as 

20 easily. 

One aspect of the present system is to store the image 
as a compressed image, and most preferably as polygons. The 
existing software package, Adobe Streamline (TM) , breaks a 
bitmap into multiple polygons. The polygons can then be 
25 defined as vectors. An additional advantage is that the 
vectors can be easily processed by the DSP. The DSP 800 
then builds the image from the vectors. Since the image is 
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defined as vectors, it can be easily related via matrix 
arithmetic. Using Adobe Streamline, for example, an 
800 kilobyte bit map can be compressed to a 30 kilobyte 
vector image. 

5 Another improvement of the present system is the 

control of the gobo using filters. 

In an analog gobo system, a filter can be used to blur 
the image, for example. Many different kinds of filters are 
used. For example, some filters randomly distort the image. 
10 Other filters affect the image in different ways. The 
blurring can be carried, out as an electronic filter. A 
preferred user interface defines the filter as a separate 
gobo that is multiplied, e.g., and ed OR ed with the first 
gobo. . 

15 More generally, a filter can be used to alter the image 

in some way, e.g., scaler the image, decay the image, or the 
like. The blur can be used to make the image apparently out 
of focus in some locations. The filter uses a second gobo 
that simulates the effect of an analog filter. For example, 

20 one operation simulates the optical effect of the glass that 
forms the filter in an analog gobo. That glass is used to 
make an algorithm that emulates the optical properties of 
the glass. Those optical properties are then pushed through 
the matrix representing the gobo, thereby effecting a 

25 digital representation of the filter. In one aspect, the 

filter is considered as a separate gobo which is OR ed with 
the second gobo. In this case, the dual gobo definition 
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described above can be used. Alternatively, the filter can 
simply be added to the gobo-def ining matrix. 

This definition has the advantage that it avoids 
defining a totally separate control. The filters are each 
5 defined as one specific gobo. There is already a manual 
that defines gobos . This manual has filters added to it. 
This avoids the need for a manual of filters. 

Another aspect defined by the present system is gobos 
that load and execute code. Some images cannot be described 

10 in terms of control. For example, images may be defined as 
some random input. Some images progress with time and 
maintain no record of their previous state. These images 
are easily defined in terms of code and in terms of a 
progression from one time to another. Hence, the gobos that 

15 load and execute code define a gobo that includes an 

associated area to hold static values. A gobo is requested 
and the code and variables that are associated with that 
gobo are copied into RAM. The variables are initially at a 
preset state. The code that is in the gobo portion is 

20 executed, using the portions in the variables. The 

variables are modified at each pass through the portion. 

Yet another feature of this system is intensity control 
over aspects of the image defining the gobo and dimming of 
the image defined thereby. Returning to the example of a 

25 bit map with 24 -bit color, such a system would include 8 

bits of red, 8 bits of green, and 8 bits of blue. It can be 
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desirable to fade the image awhile keeping the color 
constant with intensity change. 

One system uses an experimental technique to determine 
how to fade in order to maintain color constant and forms a 
5 look-up table between the constant color and the look up 
table . 

Another system directly maps the bits to color by 
defining the map as chromium using techniques from color 
television. For example, this takes the bits, and converts 
10 the valves indicating image to color or chrominance ® and 
^ image luminance (Y) of the image. The conversion between 

;D RGB and Y/C is well known. The values of Y and C which 

=£J correspond to the chrominance and luminance are then stored. 

IB The gobo can then be dimmed by reducing the Y, keeping C the 

s p 15 same. If desired, the Y/C can be converted back to RGB 
Q after dimming. 

fy Another system allows reducing the number of bits for a 

q bit map. Say, as an example, that it is desired to use a 

~ total of 8 bits to represent each pixel of the image. This 

20 could then be apportioned between the desired bits with red 
having 3 bits, green having 3 bits, and blue having 2 bits. 
This limits the amount of information in any of these 
colors. Since there are only 2 bits for blue, there are 
only four levels of blue that can be selected. This is 
25 often insufficient. 

In this system, therefore, the bits are compressed by 
assuming that two adjacent lines have exactly the same 
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values. Hence, each two lines get the same color value (but 
can have different intensity values) . Now in a system as 
described above, two lines of red can have 5 bits, two lines 
of green can have 6 bits, and two lines of blue can also 
5 have 5 bits. This provides an appropriate dynamic range for 
color at the expense of losing half the resolution for 
color. 

Moreover, this has an additional advantage in that it 
allows 5 bits 'for grey scale in such a system. 
10 A possible problem with such a system, however, as 

_ : described above, is that the information would not 

]if necessarily be aligned on byte boundaries. It could, 

W therefore, be necessary to take the whole image, manipulate 

ffl it, and then put the whole image back. 

:p 15 The basic system is shown in FIG. 9. The luminance Y 

p is an 8 -bit representation of the brightness level of the 

Hj image. The hue is then divided into dual- line multiple 

bits. Each bit is used for two lines each. 
i==f Dimming in such a system is carried out as shown in 

20 FIG. 9. For example, the blue bits 900 are multiplied in a 
hardware multiplier 902 by the luminance. Similarly, the 
green is multiplied in a second hardware multiplier 904 by 
the same luminance value. This controls the relative levels 
of red, green, and blue that are output on the RGB 
25 lines 910. 
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The multipliers that are used are very simple, since 
they simply multiply 8 bits by 3 bits. Therefore, a simple 
hardware multiplier can be used for this function. 

This provides red, green, and blue color without loss 
5 of data and with substantially perfect fading. 

An additional feature described herein is a framing 
shutter gobo. A basic framing shutter is shown in FIG. 10. 
FIG. 10 shows the circular spot of the beam, and the analog 
shutter, often called a LECO. Each analog shutter 1000 can 
10 be moved in and out in the direction of the arrows shown. 
Each shutter can also be moved in an angular direction, 
shown by the arrow 1002. There are a total of four 
shutters, which, in combination, enable framing the beam to 
a desired shape. For example, the shutter 1004 can be moved 
=p 15 to the position shown in dotted lines as 1006. When this 
O happens, the effective image that is passed becomes as shown 

fy in hatched lines in FIG. 10. Another possibility is that 

the shutter can be tilted to put a notch into the image. 

According to this system, another record is formed for 
2 0 a gobo defining a framing shutter. The framing shutter gobo 
allows control of multiple values including the positions of 
the four framing shutters 1000, 1004, 1006, and 1008. Each 
framing shutter is defined in terms of its value d, 
corresponding to the distance between one edge 1010 of the 
25 framing shutter and the edge 1011 of the original spot. In 
this system, the value d is shown representing the right- 
hand edge of the framing shutter. Another selectable value 
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is 0, which defines the angle that the front blade 1013 of 
the framing shutter makes relative to perfect horizontal or 
vertical. Yet another parameter which can be selected is 
offset O which represents the distance between the framing 
5 shutter edge 1010 and the ideal edge portion 1017. Other 
values can alternatively be specified. By controlling all 
these values, the Medusa shutter can in effect simulate any 
desired framing shutter gobo. 

The video controller and line buffer 1114 can also be 
10 formed from the field-programmable gate array. 
q A number of different special gobos are defined 

|3l according to the present system. Each of these gobos is 

;r: defined according to the record format described above. 

:1 s : These include: 

f 15 Oscilloscope. This enables simulating the output value 

O of an oscilloscope as the gobo. For example, any value that 

iy can be displayed on the oscilloscope could be used as a gobo 

p with a finite width. This could include sine waves, square 

waves, straight waves, sawtooth waves, and the like. 
20 Other variable gobos include vertical lines, moire 

lines, laser dots, radial lines, concentric circles, 
geometric spiral, bar code, moon phases, flowers and 
rotating flowers, a diamond tiling within a shape, 
kaleidoscope, tunnel vision, and others. 
25 Animated gobos correspond to those which execute codes 

described above. Some examples of these include, for 
example, self -animating random clouds; self -animating random 
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reflections; self -animating random flames, fireworks; 
randomly moving shapes such as- honeycombs, crosswords, or 
undulations; foam; random flying shapes. 



5 Control as a multi- layered image 

As described above, the present system allows 
sophisticated control of electronic images, and manipulation 
of images. The control of the gobo can be selected as a 
layered image mode. Each gobo then effectively becomes a 
10 multi -part layered image. 

A layout of the control for the system is shown in FIG. 

12 . 

Layer 1 includes gobos plus effects. This is for a 
simple image; with one gobo only and multiple effects. The 

15 second layer includes additional information. This can 

include gobos, non gobos, and/or additional effects. Third 
layers and fourth layers are similarly situated. The 
multiple layers collectively form a complex image. 

Effectively, therefore, a complex image is formed by a 

2 0 number of layers. A first layer has a gobo. Additional 

functions are defined in the other layers. This forms a 
composite image. Each layer can be operated on by the other 
layers. For example, each layer can be individually rotated 
or blurred, and/or rotation and blur can be applied to the 

25 entire image. This enables the console to be controlled 

incrementally. The gobo image is formed by adding one layer 
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then adding another layer. The multiple layers ^together 
effectively become the complex image. 

Gobo selection occurs from a gobo catalog arranged in a 
tree structure as shown in FIG. 13. Operation follows a 
5 logical path within the catalog. A route shown as 1300 
begins the operation of selecting from a tree-like 
operation. 

A first branch of the tree includes commonly used 
gobos. The gobos are also arranged by some aspect of their 

10 look, including categories shown as geometric, random, 
pictures. Within the geometric gobos, the gobos can be 
arranged by the class of the geometry, shown here as random, 
round, triangles, and the like. Again within each branch, 
there can be possibilities. Within the "round' 1 selection 

15 is single circle, two circles, three circles, four circles 
that are close, etc. Each route can have twenty branches. 

The menu shown in FIG. 13 pops up each time a category 
is selected. An important feature keeps the commonly-used 
parts close to the root of the catalog. This can be done 

20 either by selecting those gobos which are most common and 
putting these in the commonly-used paths or by taking a 
statistical selection of those gobos which are used. For 
example, a memory location could store the number of times a 
gobo is used, and those with for example the sixty highest 

25 numbers could be stored in the commonly used paths. 

Preferably those stored in the commonly used paths are also 
selectable via their parameters. The gobo catalog arranges 
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the gobos as a tree that is logically connected. Many gobos 
have multiple characteristics. Those gobos are then 
categorized based on all of those multiple characteristics, 
and those gobos can be accessed through any of the paths for 
5 any of the categories. 

Each of the layers defines an action to be taken on the 
image that forms a stencil for the light beam projection. 
The layers are combined two at a time to form a composite 
image. Then, that composite image is combined with the next 
10 layer to form a new composite image, and so on. 

The combination can be defined as any of the following: 

1) A logical "and'' of bits 

2) A logical vv or M of bits 

3) A mathematical addition of the images 
15 4) A multiplication of the images 

5) A highest text precedence combination, where the 
brightest parts of the images are taken. 

6) An exclusive or operation. 

The layered output model is controlled by names. The 
2 0 following represents the terminology used in this 
embodiment . 
GOBO 

The object from the catalog with no associated 
effects . 
2 5 EFFECT 

Tools and filters that modify a gobo. 

LAYER 
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A layer may have one of the following: 
Gobo 

Gobo with single or multiple effects 
Effect 

5 - A combination of a gobo and effects within a layer 

only modifies effects the gobo within that layer. 
Four layers of this type can form a Composite Image. 
Layers 1-4 store in the gobo palette or- directly 
into cues as ""orphans' 1 . 
10 EFFECT LAYER 

An Effect Layer is a special type of layer that does 
not contain a gobo. This layer defines and effect 
and modifies any layers prior to the effects layer. 
COMPONENT 

15 - A single gobo or effect within a layer. 

MANUAL LAYER 

All functions that simulate motorized lamp operate 
at this layer. These effect proportionally, or 
completely, anything that is stored in the image 
20 palette. The output of this layer is stored into 

cues as individual cue records. 

Simple and Complex images do not reside on the 
manual layer. 
IMAGE 

25 - The combination of layers 1-4, using any of the 

combination techniques described above. 
SIMPLE IMAGE 
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A one layer image . 
COMPLEX IMAGE 

An image having more than one layer. 
COMPOSITE IMAGE 
5 - The combination of images with the manual layer. 

The image layers described herein facilitate 
constructing and editing an image as described herein. 

The gobo menu is shown in Fig. 13. A paper based gobo 
10 catalog exists in a similar form. The gobo menu of Fig. 13 
is displayed on the Menu panel. The gobos are organized by 
type and also categorically. 

Each gobo is assigned a catalog number. This number can 
be used as a quick way to select a gobo. It is possible at 
15 any time to enter the numeric catalog number to access a 
gobo without entering the gobo menu. 

Gobos selected from the Menu panel are sent to the 
selected fixtures and can then be stored into cues or into a 
palette . 

2 0 A user-definable portion of the catalog is used for 

custom images. 

Variable/Animation Gobos 

A variable gobo is selected from the Menu panel. The 
25 appropriate number of unassigned or "wild 11 encoders 

automatically load. These encoders obtain control over the 
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variable. A variable gobo can be changed in real time 
control via the wild encoders. 

The effects menu is an additional menu mode that 
contains a list of all filters or tools used to modify an 
5 image. This does NOT include motorized functions. 

The effects menu gives the user access to effects that 
may not be loaded with control on an MPD or a wild encoder. 

AUTO /MANUAL PALETTE COLOR 
10 Any palette index may be prescribed a key color for 

organizational purposes . 

The layer editor is an expanded palette editor that 
allows views and control while building a complex image . 



15 palette, or from within an Image Cue Record. 

The editor includes copy/paste/delete options within 
the editor for layer modification. 

The Menu panel is used to display layer contents. 
THE MANUAL LAYER 

2 0 Most components of the manual layer are controlled from 

a manual* panel driver, Wild Encoder, or Numeric entry. 
Color, focus, and shutters are selected, on the manual layer 
from palettes. 



This editor may be used or accessed manually, from a 



Components of the manual layer can store into cues as 



25 



individual cue records. 
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Hardware limitations may determine how many effects can 
be simultaneously processed. Until hardware is tested, a 
reasonable number of effects may be 12. 
FILTERS 

A new filter is added to aid effect management, called 
^Ef feet ' ' . 
IMAGE RECORDS 

An Image Record contains all the information for a 
simple or complex image. 
TIMING AND DELAY defines 

Timing on components. 

Timing on layers. 

Timing on Image Records . 

Timing on manual panel drivers. 
TARGETING CUES AND CHASES 
TARGETING 

A cue record that adds or changes an effect in layer (s) 
1-4 without changing the stored value of the Image. 

Verbal explanation . 
COMBO PALETTE 

Layer Maps 

Layer Palette 

Layer Presets 
OPERATING MODES 

Shutter 

Fade 
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Although only a few embodiments have been described in 
detail above, those having ordinary skill in the art 
certainly understand that modifications are possible. 
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